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SYSTEM AND METHOD FOR QUANTITATIVE ASSESSMENT OF 
NEUROLOGICAL DISEASES AND THE CHANGE OVER TIME OF 
NEUROLOGICAL DISEASES 
Reference to Related Applications 

5 The present application claims the benefit of U.S. Provisional Application No. 

60/316,965, filed September 5, 2001, whose disclosure is hereby incorporated by 
reference in its entirety mto the presmt disclosure. 
Field of the Invention 

The present invention is directed to a system and method for quantifymg 

10 neurological diseases and their change over time and is more particularly directed to 
such a system and method which use biomaikers related to the nervous system, or 
neuromaikets. 
Description of Related Art 

Diseases of the nervous system, such as multiple sclerosis, Alzheimer's 

15 disease, and other degenerative conditions, afflict a significant percent of the 
population. In assessing those conditions, and in tracking tiieir change over time, 
including improvements due to new therapies, it is necessary to have quantitative 
information. Subjective and/or difficult to quantify measures of fimctional 
degeneration have been used in the past. Such measures lack sensitivity, and are 

20 typically usefiil only in the latter stages of disease. Less subjective measures can be 
obtained firom measurements of conventional 2D images on computed tomography 
(CT) and magnetic resonance (hASJ) images, but those are traditionally assessed 
through manual tracings, or by caHper measurements of the image. Examples of 
measurements that are taken firom MRI exanainations of multiple sclerosis patients 

25 include: lesion volume (T2, PDW, FLAIR, Gd-enhancing), whole brain volume, 
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volume of a particular part of the brain, and intra-cranial CSF volume. Typical 
measurements for assessment of Alzheimer's disease include: volume of the whole 
gray matter, white matter, CSF space, anterior and medial temporal lobe, 
hippocanapus, and entorhinal cortex. 
S Some references for the prior work include: 

Rovaris M, Inglese M, van Shijndel RA, et al. "Sensitivity and reproducibiUty 
of volume change measurements of different brain portions on magnetic resonance 
imagmg in patients with multiple sclerosis." Journal of Neurology. 247(12):960-5, 
2000. 

10 Rovaris M, Bastianello S, Capra R, et al. "Correlation between enhancing 

lesion number and volume on standard and triple dose gadolinium-enhanced brain 
MRI scans from patients with multiple sclerosis.'' Magnetic Resonance Imaging. 
17(7):985-8, 1999. 

Dastidar P, Hainonen T, Lehtimaki T, et al. **Volumes of atrophy and plaques 
IS coirelated with neurological disability in secondary progressive multiple sclerosis." 
Journal of the Neurological Sciences. 165(l):36-45, 1999. 

Guttmann CR, Kikinis R, Anderson MC, et al. "Quantitative follow-up of 
patients with multiple sclerosis using MRI: reproducibility." Journal of Magnetic 
Resonance Imaging. 9(4):509-19, 1999. 
20 Heinonen Dastidar P, Eskola H, et al. "Applicability of semi-automatic 

segmentation for volumetric analysis of brain lesions." Journal of Medical 
Engineering & Technology. 22(4): 173-8, 1998. 

Jack CR Jr, Peterson RC, O'Brien PC, et al. **MR-based Mppocampal 
volumetry in the diagnosis of Alzheimer's disease." Neurology. 42(1)183-8, 1992. 



2 



r 

wo 03/021524 PCTAJS02/28070 

Xu Y, Jack CR Jr, O'Brien PC, et al. 'Usefulness of MRI measures of 
entoihinal cortex versus hippocampus in AD." Neurology. 54(9): 1760-7, 2000. 

Brunetti A, Postiglione A, Tedeschi et aL '"Measurement of global brain 
atrophy hi Alzheimer's disease with unsupervised segmentation of spin-echo MRI 
5 studies." Journal of Magnetic Resonance Imaging, 1 1(3):260-6, 2000. 

Mizuno IC, Wakai M, Takeda A, et al. 'Medial temporal atrophy aad memory 
impairment m early stage of Alzheimer's disease: an MRI volumetric and memory 
assessment study." Jiwrna/ of Neurological Sciences 173(l):18-24, 2000. 

Juottonen K, Laasko MP, Insausti R, et al. '^oliunes of the entorhinal and 
10 perirhinal cortices in Alzheimer's disease." Neurobiology of Aging. 19(l):15-22, 
1998. 

Those measurements require manual or semi-manual systems that require a 
user to identify &e structure of interest and to trace boundaries or areas, or to initialize 
an active contour. 

IS The prior art is capable of assessing gross abnormalities or gross changes over 

time. However, the conventional measurements are not well suited to assessing and 
quantifying subtle abnormalities, or subtle changes, and are incapable of describing 
complex topology or shape in an accurate manner. Furthermore, manual and semi- 
manual measurements from raw images suffer from a high inter- and intra-observer 

20 variability. Also, manual and semi-manual measurements tend to produce ragged and 
irregular boundaries in 3D the tracings are based on a sequence of 2D images. 
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Summary of the Invention 

It will be apparent from the above that a need exists in the art to identify 
important structures or substructures, their normalities and abnormalities, and tiieir 
specific topological and morphological characteristics. It is therefore a primary object 
S of the invention to provide a more accurate quantification of neurological tissue 
structures. It is another object of the invention to provide a more accurate 
quantification of changes in time of those tissue structures. It is a further object of the 
invention to address the needs noted above. 

To achieve the above and other objects, the present invention is directed to an 

10 identification of important structures or substructures, their normalities and 
abnormalities, and to an identification of their specific topological, morphological, 
radiological and pharmacokinetic characteristics, which are sensitive indicators of 
neurological disease and the state of pathology. The abnormality and normality of 
structures, along with their topological and morphological characteristics and 

IS radiological and pharmacokinetic parameters are called biomaikers, or are 
alternatively called neuromarkers if they are specific to neurology. Specific 
measurements of the biomarkers serve as the quantitative assessment of neurological 
disease. 

The inventors have discovered that the following new biomarkers are sensitive 
20 indicators of neurological disease in humans and in animals: 

• The shape, topology, and morphology of brain lesions; 

• The sh^e, topology, and morphology of brain plaques; 

• The shape, topology, and morphology of brain ischemia; 

• The shape, topology, and morphology of brain tumors; 
25 • The spatial firequency distribution of the sulci and gyri; 
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• The compactaess (a measure of surface to volume ratio) of gray matter and white 
matter; 

• Whole brain characteristics; 

• Gray matter characteristics; 
5 • White matter characteristics; 

• Cerebral spinal fluid characteristics; 

• Hippocampus characteristics; 

• brain sub-structure characteristics; 

• The ratio of cerebral spmal fluid volume to gray matter and white matter volume; 
10 and 

• The number and volume of brain lesions. 

A preferred method for extracting the biomarkers is with statistical based 
reasoning as defined in Parker et al (US Patent 6,169,817), whose disclosure is 
hereby incorporated by reference in its entirety into the present disclosure. A 

15 preferred method for quantifying shape and topology is with the morphological and 
topological fomiulas as defined by the following references: 

Curvature Analysis: Peet, F.G., Sahota, T.S. "Surface Curvature as a Measure 
of Image Texture" IEEE Transactions on Pattern Analysis and Machine Intelligence 
1985 Vol PAMI-7 G:734-738; 

20 Struik, DJ., Lectures on Classical Differential Geometry^ 2nd ed., Dover, 

1988. 

Shape and Topological Descriptors: Duda, R.0, Hart, P.E., Pattern 
Classification and Scene Analysis, Wiley & Sons, 1973. 

Jain, A.K, Fundamentals of Digital Image Processing, Prentice Hall, 1989. 
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Spherical Haimonics: Matheny, A., Goldgof, D. "The Use of Three and Four 
Dimensional Surface Harmonics for Nonrigid Shape Recovery and Representation,*' 
IEEE Transactions on Pattern Analysis and Machine Intelligence 1995, 17: 967-981; 
Chen, C.W, Huang, T.S., Arrot, M. 'Modeling, Analysis, and Visualization of Left 
5 Ventricle Shape and Motion by Hierarchical Decon^)osition," IEEE Transactions on 
Pattern Analysis and Machine Intelligence 1994, 342-356. 

Those morphological and topological measurements have not in the past been 
applied to those neurological biomaikers. 

The quantitative assessment of the new biomarkers listed above provides an 

10 objective measurement of tiie state of the nervous system, particularly in the 
progression of neurological disease. It is also very useful to obtain accurate 
measurements of those biomarkers over time, particularly to judge the degree of 
response to a new therapy, or to assess the trends with increasing age. Manual and 
semi-manual tracings of conventional biomarkers (such as the simple volume of the 

15 brain) have a high inherent variability, so that as successive scans are traced, the 
variability can hide subtle trends. That means that only gross changes, sometimes 
over very long time periods, can be verified using conventional methods. The 
inventors have discovered that extracting the biomarker using statistical tests and 
treating the biomarker over time as a 4D object, with an automatic passing of 

20 boundaries from one time interval to the next, can provide a higihly accurate and 
reproducible segmentation fix)m which trends over time can be detected. That 
preferred approach is defined in the above-cited Parker et al patent Thus, the 
combination of selected biomarkers that themselves capture subtie pathologies, with a 
4D approach to increase accuracy and reliability over time, creates sensitivity that has 

25 not been previously obtainable. 
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Brief Description of the Drawings 

A preferred embodiment of tbie present invention will be set forth in detail 
with reference to the drawings, in which: 

Fig. 1 shows a flow chart of an overview of the process of the preferred 
S embodiment; 

Fig. 2 shows a flow chart of a segmentation process used in the process of Fig. 

1; 

Fig. 3 shows a process of tracking a segmented image in multiple images 
taken over time; and 

10 Fig. 4 shows a block diagram of a syst^ on which the process of Figs. 1-3 

can be implemented. 
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Detailed Description of the Preferred Embodiment 

A preferred embodiment of the present invention will now be set forth with 
reference to the drawuigs. 

Fig. 1 shows an overview of the process of identifying biomarkers and their 
5 trends over time. In step 102, a three-dimensional image of the region of interest is 
taken. In step 104, at least one biomarker is identified in the image; the technique for 
doing so will be cxplsined with reference to Fig. 2. Also in step 104, at least one 
quantitative measuremmt is made of the biomarker. In step 106, multiple three- 
dimensional images of the same region of the region of interest are taken over time. 

10 hi some cases, step 106 may be completed before step 104; the order of those two 
steps is a matter of convenience. In step 108, the same biomarker or biomarkers and 
their quantitative measurements are identified in the images taken over time; the 
technique for doing so will be explained with reference to Fig. 3. The identification 
of the biomarkers in the multiple image allows the development in step 110 of a 

IS model of the region of interest in four dimensions, namely, three dimensions of space 
and one of time. From that model, the development of the biomarker or biomaiicers 
can be tracked over time in step 1 12. 

The preferred method for extracting the biomarkers is with statistical based 
reasoning as defined in Parker et al (US Patent 6,169,817), whose disclosure is 

20 hereby incorporated by reference in its entirety into the present disclosure. From raw 
image data obtained through magnetic resonance imaging or the like, an object is 
reconstructed and visualized in four dimensions (both space and time) by first 
dividing the first image in the sequence of images into regions through statistical 
estimation of the mean value and variance of the image data and joining of picture 

25 elements (voxels) that are sufficientiy similar and then extrapolating the regions to the 
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remainder of the images by using known motion characteristics of components of the 
image (e.g., spring constants of muscles and tendons) to estimate the rigid and 
defonnational motion of each region fix)m image to image. The object and its regions 
can be rendered and interacted with in a four-dimensional (4D) virtual reality 
5 environment, the four dimensions being three spatial dimensions and time. 

The segmentation will be explained with reference to Fig. 2. First, at step 201, • 
the images in the sequence are taken, as by an MRL Raw image data are thus 
obtained. Then, at step 203, the raw data of the first image in the sequence are iiqput 
into a computing device. Next, for each voxels the local mean value and region 

10 variance of the image data are estimated at step 205. The connectivity among the 
voxels is estimated at step 207 by a comparison of the mean values and variances 
estimated at step 205 to form regions. Once the connectivity is estimated, it is 
determined which regions need to be spUt, and those regions are split, at step 209. 
The accuracy of those regions can be improved still more through the segmentation 

15 relaxation of step 21 1. Then, it is detemiined which regions need to be merged, and 
those regions are merged, at step 213. Again, segmentation relaxation is perfoimed, 
at step 215. Thus, the raw image data are converted into a segmented image, which is 
the end result at step 217. Further details of any of those processes can be found in 
the above-cited Parker et al patent. 

20 The creation of a 4D model (in three dimensions of space and one of time) 

will be described with reference to Fig. 3. A motion tracking and estimation 
algorithm provides the information needed to pass the segmented image from one 
frame to another once the first image in ttie sequence and the completely segmented 
image derived therefrom as described above have been input at step 301. The 

25 presence of both the rigid and non-rigid components should ideally be taken into 
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account in the estimation of the 3D motion. According to the present invention, the 
motion vector of each voxel is estimated after the registration of selected feature 
points in the image. 

To take into consideration the movement of the many structures present in the 
5 region of interest, the approach of the present invention takes into account the local 
deformations of soft tissues by using a priori knowledge of the material properties of 
the different structures found in the image segmentation. Such knowledge is input in 
an appropriate database form at step 303. Also, different strategies can be applied to 
the motion of the rigid structures and to that of the soft tissues. Once the selected 

10 points have been registered, the motion vector of every voxel in the image is 
computed by interpolating the motion vectors of the selected points. Once the motion 
vector of each voxel has been estimated,, .the segmentation of the n^t image in the 
sequence is just the propagation of the segmentation of the former image. That 
technique is repeated until every unage in the sequence has been analyzed. 

IS The definition of time and tiie order of sequencing can be reversed for the 

purpose of analysis. For example, brain lesions in the final image may be used as a 
starting point, with time reversal processing. Similarly, the midpoint of a time series 
may be used as a convenient starting point, with anal}^is proceeding in both forward 
and reverse directions. 

20 Finite-element models (FEM) are known for the analysis of images and for 

time-evolution analysis. The present invention follows a similar approach and 
recovers the point correspondence by minimiziag the total energy of a mesh of masses 
and springs that models the physical properties of the anatomy. In the presmt 
invention, the mesh is not constrained by a single structure in the image, but instead is 

25 free to model the whole volumetric image, in which topological properties are 
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supplied by the first segmented image and the physical properties are supplied by the 
a priori properties and the first segmented image. The motion estimation approach is 
an FEM-based point correspondence recovery algorithm between two consecutive 
images in the sequence. Each node in the mesh is an automatically selected feature 
5 point of the image sought to be tracked, and the spring.sti£&iess is computed fi:om the 
first segmented image and a priori knowledge of the human anatomy and typical 
biomechanical properties for the tissues in the region of interest. 

Many defonnable models assume that a vector force field that drives spring- 
attached point masses can be extracted firom the image. Most such models use that 
10 s^proach to build semi-automatic feature extraction algoridxms. The present 
invention employs a similar approach and assumes that the image sampled at / = n is a 
set of three dynamic scalar fields: 

= ten(x), \7gn(x)l VVn(x)}, 

namely, the gray-scale image value, the magnitude of the gradient of the image value, 
15 and the Laplacian of the im^e value. Accordingly, a change in 0(x, t) causes a 
quadratic change in the scalar field energy l7o(x) oc (AO(x))^. Furthermore, the 
stmctures underlying the image are assumed to be modeled as a mesh of spring- 
attached point masses in a state of equilibrium with those scalar fields. Although 
equilibrium assumes that there is an external force field, the shape of the force field is 
20 not inq)ortant The distribution of the point masses is assumed to change in time, and 
the total energy change in a time period A/ after time ^ = w is given by 
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where a, p, and y are weights for the contribution of every individual field change, t| 
weighs the gain in the strain energy, K is the FEM stifbess matrix, and AX is the 
FEM node displacement matrix. Analysis of that equation shows that any change in 
the image jSelds or in the mesh point distribution increases the system total energy. 
5 Therefore, the point correspondence from gn to gn+i is given by the mesh 
configuration whose total energy variation is a minimum. Accordingly, the point 
correspondence is given by 

where 

10 A^ = min^Ai7„(A^). 

hi tfiat notation, minp q is the value of p that minimizes q. 

While the equations set forth above could conceivably be used to estimate the 
motion (point correspondence) of every voxel in the image, the number of voxels, 
which is typically over one million, and the complex nature of the equations make 

15 global minimization difficult To simplify the problem, a coarse FEM mesh is 
constructed with selected pouits from the image at step 305. The energy minimization 
gives the point correspondence of the selected points. 

The selection of such points is not trivial. First, for practical purposes, the 
number of points has to be very small, typically = 10^; care must be taken that the 

20 selected points describe the whole image motion. Second, region boundaries are 
important features because boundary tracking is enough for accurate region motion 
description. Third, at region boundaries, the magnitude of the gradient is high, and 
the Laplacian is at a zero crossing point, making region boundaries easy features to 
track. Accordingly, segmented boimdary points are selected in the construction of the 

25 FEM. 
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Although the bomidary points represent a small subset of the image points, 
there are still too many boundary points for practical purposes. In order to reduce the 
number of points, constrained random sampling of the boundary points is used for the 
point extraction step. The constraint consists of avoiding the selection of a point too 
S close to the points already selected. That constraint allows a more unifom selection 
of the points across the boundaries. Finally, to reduce the motion estimation error at 
points internal to each region, a few more points of the image are randomly selected 
using the same distance constraint. Experimental results show that between 5,000 and 
10,000 points are enough to estimate and describe the motion of a typical volumetric 

10 image of 256x256x34 voxels. Of the selected points, 75% are arbitrarily chosen as 
boundary points, while the remaining 25% are interior points. Of course, other 
percentages can be used where appropriate. 

Once a set of points to track is selected, the next step is to construct an FEM 
mesh for those points at step 307. The mesh constrains the kind of motion allowed by 

15 coding the material properties and the interaction properties for each region. The first 
step is to find, for every nodal point, the neighboring nodal point. Those skilled in the 
art will appreciate that the operation of finrfitig the neighboring nodal point 
corresponds to building the Voronoi diagram of the mesh. Its dual, flie Delaunay 
triangulation, represents the best possible tetrahedral finite element for a given nodal 

20 configuratioiL The Voronoi diagram is constructed by a dilation appro^ich. Under 
ttiat approach, each nodal point in the discrete volume is dilated. Such dilation 
achieves two purposes. First, it is tested when one dilated point contacts another, so 
that neighboring points can be identified. Second, every voxel can be associated with 
a point of the mesh. 
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Once every point Xi has been associated witii a neighboring point xy, the two 
points are considered to be attached by a spring having spring constant k'j, where / 

and m identify the materials. The spring constant is defined by the material 
interaction properties of the connected points; those material interaction properties are 
5 predefined by the user in accordance with known properties of the materials. If the 
connected points belong to tiie same region, the spring constant reduces to kj^ and is 

derived firom the elastic properties of the material in the region. If the connected 
points belong to different regions, the spring constant is derived Scorn the average 
interaction force between the matmals at the boundary. 

10 In theory, the interaction must be defined between any two adjacent regions. 

In practice, however, it is an acceptable approximation to define the Interaction only 
between major anatomical components in the image and to leave the rest as arbitrary 
constants. In such an approximation, the error introduced i$ not significant compared 
with other errors introduced in the assumptions set forth above. 

15 Spring constants can be assigned automatically, particularly if the region of 

interest includes tissues or structures whose approximate size and image intensity are 
known a priori, e.g., bone. Segmented image regions matching the a priori 
expectations are assigned to the relatively rigid elastic constants for bone. Soft tissues 
and growing or shrinking brain lesions are assigned relatively soft elastic constants. 

20 Once the mesh has been set up, the next image in the sequence is input at step 

309, and the energy between the two successive images in the sequence is minimized 
at step 311. The problem of minimizing the energy U can be split into two separate 
problems: minimizing the energy associated with rigid motion and minimizing that 
associated with deformable motion. While both energies use the same energy 

25 function, they rely on different strategies. 
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The rigid motion estimation relies on the fact that the contribution of rigid 
motion to the mesh deformation energy (AX^KAX)/2 is very close to zero. The 
segmentation and the a priori knowledge of the anatomy indicate which points belong 
to a rigid body. If such points are selected for every individual rigid region, the rigid 
S motion energy minimization is accomplished by finding, for each rigid region Ru the 
rigid motion rotation R,- and the translation T,- that minimize that region's own energy: 

^H^-rmxi^U^^ ;[;(A;e = min^,J7„(A^,)) 

where AX,- = Ri-X,- + T,*X,- and Ax,, is the optimum displacemmt matrix for the points 

that belong to the rigid region Ru That minimization problem has only six degrees of 
10 fireedom for each rigid region: three in the rotation matrix and three in the translation 
matrix. Therefore, the twelve components (nine rotational and three translational) can 
be found via a six-dimensional steepest-desceat technique if the difference between 
any two images in the sequence is small enough. 

Once the rigid motion parameters have been found, the deformational motion 
15 is estimated through mmiinization of the total system energy U. That mininiization 
cannot be simplified as much as the minimization of the rigid energy, and without 
fiirther considerations, the number of degrees of fireedom in a 3D defonnable object is 
three times the number of node points in the entire mesh. The nature of the problem 
allows the use of a simple gradient descent technique for each node in the mesh. 
20 From the potential and kinetic energies, the Lagrangian (or kinetic potential, defined 
in physics as the kinetic energy minus the potential energy) of the system can be used 
to derive the Euler-Lagrange equations for every node of the system where the driving 
local force is just the gradient of the energy field. For every node in the mesh, the 
local energy is given by 
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ia{gSx,+Ax)-g,M)y +(>5(|Vg„(^, + Ax)|-lV^„,,(x,)t))^ + 

where represents a neighborhood in the Voronoi diagram. 

Thus, for every node, there is a problem in three degrees of freedom whose 
minimization is performed using a simple gradient descrait technique that iteratively 
reduces the local node energy. The local node gradient descent equation is 
x^in + 1) = x,in) - y^U^,,inM 

where the gradient of the mesh energy is analytically computable, the gradient of the 
field energy is numerically estimated from the image at two different resolutions, 
x(7i+l) is the next node position, and v is a weighting factor for the gradient 
contribution. 

At every step in the minimization, the process for each node takes into account 
the neighboring nodes* former displacement. The process is repeated until the total 
energy reaches a local r^fimi mnm, which for small deformations is close to or equal to 
the global minimum. The displacement vector thus found represents the estimated 
motion at the node points. 

Once the minimization process just described yields the sampled displacraient 
field AX, that displacement field is used to estimate tibe dense motion field needed to 
track the segmentation from one image in the sequence to the next (step 313). The 
dense motion is estimated by weighting the contribution of every neighbor mode in 
the mesh. A constant velocity model is assumed, and the estimated velocity of a 
voxel X at a time t is v(x, t) = Ax(0/A/. The dense motion field is estimated by 

16 
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-1-1 

A^'" is the spring constant or stiffiiess between the materials / and m associated with 
the voxels x and xj. A/ is the time interval between successive images in the sequence, 
5 |x - 39I is the simple Euclidean distance between the voxels, and the interpolation is 
performed usmg the neighbor nodes of the closest node to the voxel x. That 
interpolation weights the contribution of every neighbor node by its material property 
kj-J ; ihas, the estimated voxel motion is similar for every homogeneous region, even 

at Hie boimdary of that regioiL 
10 Then, at step 315, the next image in the sequence is filled with the 

segmentation data. That means that the regions determined in one image are carried 
over into the next image. To do so, the velocity is estimated for every voxel in that 
next image. That is accomplished by a reverse ms?)ping of the estimated motion, 
which is given by 

15 vix,t + At) = ^ Yi^ixj,t) 

where H is the number of points that fall into the same voxel space 5(x) in tiie next 
unage. That mapping does not fill all the space at time t^At, but a simple 
interpolation between mapped neighbor voxels can be used to fill out tiiat space. 
Once the velocity is estimated for every voxel m tiie next image, the segmentation of 
20 that image is sitrq>ly 

L{x, t + At) = Lix- v(jc, t + At) At, t) 

where Kji^) and L(x^At) are the segmentation labels at the voxel x fiw the times t 
and t+At. 
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At step 317, the segmentation thus developed is adjusted through relaxation 
labeling, such as that done at steps 21 1 and 215, and fine adjustments are made to the 
mesh nodes in the image. Then, the next image is isxpvt at step 309, unless it is 
determined at step 319 that the last intiage in the sequence has been segmented, in 
S which case the operation ends at step 321. 

The operations described above can be implemented ia a system such as that 
shown in the block diagram of Fig. 4. Systan 400 includes an input device 402 for 
input of the image data, the database of material properties, and flie like. The 
information input through the input device 402 is received in the workstation 404, 

10 which has a storage device 406 such as a hard drive, a processing unit 408 for 
performing the processing disclosed above to provide the 4D data, and a graphics 
rendering engme 410 for preparing the 4D data for viewing, e.g., by surface 
rendering. An output device 412 can include a monitor for viewing the images 
rendered by the rendering engine 410, a further storage device such as a video 

15 recorder for recording the images, or both. Illustrative examples of the workstation 
304 and the graphics rendering engine 410 are a Silicon Graphics Indigo workstation 
and an Irix Explorer 3D graphics engine. 

Shape and topology of the identified biomarkers can be quantified by any 
suitable techniques known in analytical geometry. The preferred method for 

20 quantifying shape and topology is with the morphological and topological formulas as 
defined by the references cited above. 

The data are then analyzed over time as the individual is scanned at later 
intervals. There are two types of presentations of the time trends fliat are preferred. 
In one class, successive measurements are overlaid in rapid sequence so as to form a 

25 movie. In the complemmtary representation, a trend plot is drawn giving &e higher 
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order measures as a function of time. For example, the mean and standard deviation 
(or range) of a quantitative assessment can be plotted for a specific local area, as a 
function of time. 

The accuracy of those measurements and their sensitivity to subtle changes in 
5 small substructures are highly dependent on the resolution of the imagmg system. 
Unfortunately, most CT, MRI, and ultrasound systems have poor resolution in the 
out-of-plane, or "z" axis. While the in-plane resolution of those sj^tems can 
commonly resolve objects that are just under one millimeter in separatioii, the out-of- 
plane (slice thickness) is commonly set at 1.5mm or even greater. For assessing 

10 subtle changes and small defects using higher order structural measurements, it is 
desirable to have better than one millimeter resolution in all three orthogonal axes. 
That can be accomplished by fiision of a high resolution scan in the orthogonal, or 
out-of-plane direction, to create a high resolution voxel data set (Pena, J.-T., 
Totterman, S.M.S., Park^, K.J. '*MRI Isotropic Resolution Reconstruction jfrom Two 

15 Orthogonal Scans," SPIE Medical Imaging, 2001, hereby incorporated by reference in 
its entirety into the present disclosure). Ih addition to the assessment of subtle 
defects in structures, that high-resolution voxel data set enables more accurate 
measurement of structures that are thin, curved, or tortuous. 

In following the response of a person or animal to therapy, or to monitor the 

20 progression of disease, it is desirable to accurately and precisely monitor the trends in 
biomarkers over time. That is difficult to do in conventional practice since repeated 
scans must be reviewed independently and flie biomarkers of interest must be traced 
or measured manually or semi-manuaUy witii each time interval representing a new 
and tedious process for repeating the measurements. It is highly advantageous to take 

25 a 4D approach, such as was defined in the above-cited patent to Parker et a/, where a 
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biomarker is identified with statistical reasoning, and the biomarker is tracked jfrom 
scan to scan over time. That is, the initial segmentation of the biomarker of uiterest is 
passed on to the data sets from scans taken at later intervals. A search is done to track 
the biomarker boundaries from one scan to the next The accuracy and precision and 
S reproducibility of that approach is superior to that of perfonning manual or semi- 
manual measurements on images with no automatic tracking or passing of boundary 
infomiation from one scan interval to subsequent scans. 

The quantitative assessment of the new biomarkers listed above provides an 
objective measurement of the state of the region of interest, particularly in the 

10 progression of neurological diseases. It is also very useful to obtain accurate 
measurements of those biomarkers over time, particularly to judge the degree of 
response to a new therapy, or to assess the trends with increasing age. Manual and 
semi*manual tracings of conventional biomarkers (such as the simple thickness or 
volume of the cartilage) have a high inherent variability, so as successive scans are 

15 traced the variability can hide subtle trends. That means that only gross changes, 
sometimes over very long time periods, can be verified in conventional methods. The 
inventors have discovered that by extracting the biomarker using statistical tests, and 
by treating the biomarkOT ovct time as a 4D object, with an automatic passing of 
boundaries fi:om one time interval to the next, provides a highly accurate and 

20 reproducible segmentation fi:om which trends over time can be detected Thus, the 
combination of selected biomarkers that themselves capture subtle pathologies, with a 
4D approach to increase accuracy and reliability over time, creates sensitivity that has 
not been previously obtainable. 

While a preferred embodiment of the invention has been set forth above, those 

25 skilled in the art who have reviewed the present disclosure will readily appreciate that 
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other embodiments can be realized within the scope of the present invention. For 
example, any suitable imaging technology can be used. Therefore, the present 
invention should be construed as limited only by the appended claims. 
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We claim: 

L A method for assessing a neurological condition of a patient, the method 
comprising: 

(a) taking at least one three-dimensional image of a region of interest of the 
5 patient, the region of interest comprising part of the nervous system of the patient; 

(b) identifying, in the at least one three-dimensional image, at least one 
biomarker of the nervous system of the patient; 

(c) deriving at least one quantitative measurement of the at least one 
biomaikers; and 

10 (d) storing an identification of the at least one biomarker and the at least one 

quantitative measurement in a storage medium. 

2. The method of claim 1, wherein step (d) comprises storing the at least one 
three-dimensional image in the storage medium. 

3. The method of claim 1, wherein step (b) comprises statistical segmentation 
15 of the at least one three-dimensional image to identify the at least one biomarker. 

4. The method of claim 1, wherein the at least one three-dimensional image 
comprises a plurality of three-dimensional images of the region of interest taken over 
time. 

5. The method of claim 4, wherein step (b) comprises statistical segmentation 
20 of a three-dimensional image selected firom the plurality of three-dimensional ims^es 

to identify the at least one biomarker. 

6. The method of claim 5, wherein step (b) further comprises motion tracking 
and estimation to identify the at least one biomarker in the plurality of three- 
dimensional images in accordance with the at least one biomarker identified in the 

25 selected three-dimensional image. 
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7. The method of claim 6, wherein the pluraUty of three-dimensional images 
and the at least one biomarker identified in the plurality of three-dimensional images 
are used to form a model of the region of interest and the at least one biomarker in 
three dimensions of space and one dimension of time. 
5 8. The method of claim 7, wherein the biomarker is tracked over time in the 

model. 

9. The method of claim 1, wherein a resolution in all three dimensions of the 
at least one three-dimensional image is finer than 1 mm. 

10. The method of claim 1, wherein the at least one biomarker is selected firom 
10 &e group consisting of: 

® a shape, topology, and morphology of brain lesions; 

• a shape, topology, and morphology of bram plaques; 

• a shape, topology, and morphology of brain ischemia; 

• a shape, topology, and morphology of brain tumors; 
IS •a spatial firequency distribution of sulci and gyri; 

• a compactness of gray matter and white matter; 

• whole brain characteristics; 

• gray matter characteristics; 

• white matter characteristics; 

20 • cerebral spinal fluid characteristics; 

• hippocampus characteristics; 

• brain sub-structure characteristics; 

• a ratio of cerebral spinal fluid volume to gray matter and white matter volume; 
and 

25 • a number and volume of brain lesions. 
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11. The method of claim 1, wherein step (a) is perfonned through magnetic 
resonance imaging. 

12. A system for assessing a neurological condition of a patient, the system 
comprising: 

5 (a) an input device for receiving at least one three-dimeosional image of a 

region of interest of the patient, the region of interest comprising part of the nervous 
system of the patient; 

(b) a processor, in communication with the input device, for receiving the at 
least one three-dimensional image of the region of interest, identifying, in the at least 

10 one fbree-dimensional image, at least one biomarker of fhe nervous system of the 
patient and deriving at least one quantitative measurement of the at least one 
biomarker; 

(c) storage, in communication with the processor, for storing an identification 
of the at least one biomarker and the at least one quantitative measurement; and 

15 (d) an output device for displaying the at least one three-dimensional image, 

the id^tification of the at least one biomarker and the at least one quantitative 
measurement. 

13. The systerh of claim 12, wherein the storage also stores the at least one 
three-dimensional image. 

20 14. The system of claim 12, wherein the processor identifies the at least one 

biomarker. through statistical segmentation of the at least one three-dimensional 
image. 

15. The system of claim 12, wherein the at least one three-dimensional image 
comprises a plxurality of three-dimensional images of the region of interest taken over 
25 time. 
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16. The system of claim 15, wherein the processor identifies the at least one 
bionuarkers through statistical segmentation of a three-dimensional image selected 
fiom the plurality of three-dimensional images. 

17. The system of claim 16, wherein the processor uses motion tracking and 
5 estimation to identify the at least one biomarker in the plurality of three-dimensional 

images in accordance with the at least one biomarker identified in the selected three- 
dimensional image. 

18. The system of claim 17, wherein the plurality of three-dimensional images 
and the at least one biomarker idmtified in the plurahty of three-dimensional images 

10 are used to form a model of the region of interest and the at least one biomarker in 
three dimensions of space and one dimension of time. 

19. The system of claim 12, wherein a resolution in all three dimensions of the 
at least one three-dimensional image is finer than 1 mm. 

20. The system of claim 12, wherein the at least one biomarker is selected 
IS from the group consisting of: 

• a shape, topology, and morphology of brain lesions; 

• a shape, topology, and morphology of brain plaques; 

• a shape, topology, and morphology of brain ischemia; 

• a shape, topology, and morphology of brain tmnors; 
20 • a spatial fi:equency distribution of sulci and gyri; 

• a compactness of gray matter and white matter; 

• whole brain characteristics; 

• gray matter characteristics; 

• white matter characteristics; 

25 • cerebral spinal fluid characteristics; 
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hippocampus characteristics; 
brain sub-structure characteristics; 

a ratio of cerebral spinal fluid volume to gray matter and white matter volume; 
and 

a number and volume of brain lesions. 
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